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-The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
THE REPLY FILED 08 November 2007 FAILS TO PLACE THIS APPLICATION IN CONDITION FOR ALLOWANCE. 
1 . 13 The reply was filed after a final rejection, but prior to or on the same day as filing a Notice of Appeal. To avoid abandonment of 
this application, applicant must timely file one of the following replies: (1) an amendment, affidavit, or other evidence, which 
places the application in condition for allowance; (2) a Notice of Appeal (with appeal fee) in compliance with 37 CFR 41 .31 ; or (3) 
a Request for Continued Examination (RCE) in compliance with 37 CFR 1 .1 14. The reply must be filed within one of the followinq 
time periods: 

a) □ The period for reply expires months from the mailing date of the final rejection. 

b) ^ The period for reply expires on: (1) the mailing date of this Advisory Action, or (2) the date set forth in the final rejection, whichever is later In 

no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of the final rejection. 

Examiner Note: If box 1 is checked, check either box (a) or (b). ONLY CHECK BOX (b) WHEN THE FIRST REPLY WAS FILED WITHIN 

TWO MONTHS OF THE FINAL REJECTION. See MPEP 706.07(f). 
Extensions of time may be obtained under 37 CFR 1.136(a). The date on which the petition under 37 CFR 1.136(a) and the appropriate extension fee 
have been filed is the date for purposes of determining the period of extension and the corresponding amount of the fee. The appropriate extension fee 
under 37 CFR 1 .17(a) is calculated from: (1) the expiration date of the shortened statutory period for reply originally set in the final Office action- or (2) as 
set forth in (b) above, if checked. Any reply received by the Office later than three months after the mailing date of the final rejection, even if timely filed 
may reduce any earned patent term adjustment. See 37 CFR 1 .704(b). 
NOTICE OF APPEAL 

2. □ The Notice of Appeal was filed on . A brief in compliance with 37 CFR 41 .37 must be filed within two months of the date of 

filing the Notice of Appeal (37 CFR 41 .37(a)), or any extension thereof (37 CFR 41 .37(e)), to avoid dismissal of the appeal. Since 
a Notice of Appeal has been filed, any reply must be filed within the time period set forth in 37 CFR 41 .37(a) 
AMENDMENTS 

3. □ The proposed amendment(s) filed after a final rejection, but prior to the date of filing a brief, will not be entered because 

(a) □ They raise new issues that would require further consideration and/or search (see NOTE below); 

(b) □ They raise the issue of new matter (see NOTE below); 

(c) □ They are not deemed to place the application in better form for appeal by materially reducing or simplifying the issues for 

appeal; and/or 

(d) Q They present additional claims without canceling a corresponding number of finally rejected claims. 

NOTE: _. (See 37 CFR 1 .1 16 and 41 .33(a)). 

4. □ The amendments are not in compliance with 37 CFR 1 .121 . See attached Notice of Non-Compliant Amendment (PTOL-324). 

5. □ Applicant's reply has overcome the following rejection(s): . 

6. □ Newly proposed or amended claim(s) would be allowable if submitted in a separate, timely filed amendment canceling the 

non-allowable claim(s). 

7. For purposes of appeal, the proposed amendment(s): a) □ will not be entered, or b) will be entered and an explanation of 
how the new or amended claims would be rejected is provided below or appended. 

The status of the claim(s) is (or will be) as follows: 

Claim(s) allowed: . 

Claim(s) objected to: . 

Claim(s) rejected: 1 to 21 . 

Claim(s) withdrawn from consideration: . 

AFFIDAVIT OR OTHER EVIDENCE 



8. □ The affidavit or other evidence filed after a final action, but before or on the date of filing a Notice of Appeal will not be entered 

because applicant failed to provide a showing of good and sufficient reasons why the affidavit or other evidence is necessary and 
was not earlier presented. See 37 CFR 1 .1 16(e). 

9. □ The affidavit or other evidence filed after the date of filing a Notice of Appeal, but prior to the date of filing a brief, will not be 

entered because the affidavit or other evidence failed to overcome all rejections under appeal and/or appellant fails to provide a 
showing a good and sufficient reasons why it is necessary and was not earlier presented. See 37 CFR 41 .33(d)(1). 

10. □ The affidavit or other evidence is entered. An explanation of the status of the claims after entry is below or attached 
REQUEST FOR RECONSIDERATION/OTHER 



1 1 . ^ The request for reconsideration has been considered but does NOT place the application in condition for allowance because* 
See Continuation Sheet. 

2. □ Note the attached Information Disclosure Statement(s). (PTO/SB/08) Paper No(s). 



13. DOther: _ 



Martin Lerner 
Examiner 
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Continuation of 1 1 . does NOT place the application in condition for allowance because: 

Regarding independent claims 1,5,9, and 1 3 to 1 5, Applicant's arguments are not persuasive because they fail to consider what one 
having ordinary skill in the art would have understood as a whole from the suggestions of Verma et al. (*351). Applicant's claimed method, 
device, and system includes the basic idea of recognizing speech from audio signals if the audio signals can be recognized, and 
recognizing speech from video signals if the audio signals cannot be recognized. Verma et al. ('351) suggests at least as much to one 
having ordinary skill in the art as recognizing speech from video signals if the audio signals cannot be recognized by utilizing 
complementary weights. (Column 4, Lines 9 to 51) Applicant's arguments do not give due consideration to what is suggested to one 
having ordinary skill by Verma et al. ('351), but only gloss over the disclosure of the weights of Verma et al. ('351). The log likelihoods of 
the phone class are a summation of an audio term and a video term. Thus, Verma et al. ('351) not only utilizes the video term if the 
confidence in the audio term is zero, but conversely, would utilize only the audio term if the confidence in the video term is zero. Verma et 
al. ('351) says that the concept is founded in the recognition that the reliability of a classifier may vary from sample to sample, and the 
strategy resides in assigning different confidences to different classifiers to improve classification accuracy by decision fusion. (Column 1 , 
Lines 55 to 66) Applicant's amendments to claims 1, 5, 9, and 13 to 15 do not substantially change the scope of the the claims by saying ' 
that the video signals are processed "based on a detection that" instead of "if it is detected that" the audio signal cannot be processed. 
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